Camera zoom level and image frame capture control

ABSTRACT

Methods, devices, and systems for controlling imaging operations in electronic image capture devices are disclosed. In some aspects, a device includes processor coupled to a camera module, a user input surface, and a memory. The processor can be configured to receive, from the user input surface, a continuous user input. The continuous user input can include, at least, a first portion and a second portion. The processor can be further configured to control a first imaging operation based on a first input type received during the first portion and control a second imaging operation based on a second input type received during the second portion. The first input type can include movement of an input element relative to the user input surface, for example, and the second imaging operation can be different than the first imaging operation.

CLAIM OF PRIORITY UNDER 35 U.S.C. § 119

The present Application for Patent is a continuation of InternationalApplication No. PCT/US2018/063438, filed Nov. 30, 2018, entitled “CAMERAZOOM LEVEL AND IMAGE FRAME CAPTURE CONTROL,” which is a continuation ofU.S. patent application Ser. No. 15/830,851 (now U.S. Pat. No.10,594,925 granted on Mar. 17, 2020), filed Dec. 4, 2017, entitled“CAMERA ZOOM LEVEL AND IMAGE FRAME CAPTURE CONTROL,” all of which areassigned to the assignee hereof and hereby expressly incorporated byreference herein in their entireties as if fully set forth below and forall applicable purposes.

FIELD

Aspects of this disclosure relate generally to electronic image capturedevices. More specifically, some aspects of this disclosure relate tocontrolling imaging operations in electronic image capture devices.

BACKGROUND

An electronic device may include, or have access to image data receivedfrom, one or more camera modules. In such devices, an imaging operationsuch as a zoom level adjustment of the one or more camera modules may becontrolled. For example, a zoom level adjustment of a camera module canbe increased (e.g., a “zoom-in” operation) to increase an overall sizeof a subject relative to an image frame. Additionally, a zoom level ofthe camera module can be decreased (e.g., a “zoom-out” operation) todecrease an overall size of a subject relative to an image frame and/orto capture more portions of a scene within the image frame.Additionally, other imaging operations can be controlled.

SUMMARY

Aspects of the present disclosure are directed to methods and devicesfor controlling, at least, first and second imaging operations. In oneaspect a device includes a memory and a processor. The processor iscoupled to the memory. The processor is also coupled to a camera moduleand a user input surface. The processor is configured to receive, fromthe user input surface, a continuous user input. The user input includesa first portion and a second portion. The processor is also configuredto control a first imaging operation based on a first input typereceived during the first portion. The first input type includesmovement of an input element relative to the user input surface. Theprocessor is also configured to control a second imaging operation basedon a second input type received during the second portion. The secondimaging operation is of a different type of imaging operation than thefirst imaging operation.

In some aspects, the device can also include the camera module and atouch-sensitive display including the user input surface. The processorcan be configured to cause the touch-sensitive display to display apreview stream received from the camera module during the first portionof the continuous user input. The first imaging operation can include,for example, a zoom level adjustment operation and the second imagingoperation can include an image frame capture operation. In some aspects,the zoom level adjustment operation can include a digital zoomoperation, an optical zoom operation, and/or a combined digital andoptical zoom operation. In some aspects, the zoom level adjustmentoperation can include transitions between two or more cameras associatedwith the device.

In other aspects, the processor can be configured to cause thetouch-sensitive display to display a graphical user interface element.The processor can be configured to cause the touch-sensitive display todisplay the graphical user interface element in response to theinitiation of the continuous user input. Further, a location of thegraphical user interface element relative to the user input surface canbe based on a location of the continuous user input. The graphical userinterface element, in some examples, can include a first region and asecond region. The first input type can include movement of the inputelement along the user input surface over at least a portion of thefirst region, and the second input type can include a movement of theinput element along the user input surface between the first region andthe second region. In some examples, the movement of the input elementduring the first portion along the user input surface can cause thesecond region to move relative to the first region during the firstportion of the continuous user input, and the movement of the secondregion during the first portion can track a location of the inputelement relative to the user input surface as the input element movesrelative to the first region.

In other aspects, the first input type can include a twist of the inputelement relative to the user input surface and/or a translation of theinput element relative to the user input surface. The second input typecan include, for example, a release of the input element from the userinput surface and/or a translation of the input element relative to theuser input surface. The input element can include a first structure thattranslates relative to the user input surface and a second structurethat translates relative to the user input surface during the firstportion. The first structure and the second structure can be spacedapart from each other on a plane that is parallel to the user inputsurface, and the second input type can include a translation of thefirst structure relative to the user input surface while the secondstructure is stationary relative to the user input surface during thefirst portion. The second input type can include a release of at leastone of the first structure and the second structure from the user inputsurface.

In another aspect, the processor can be coupled to a second cameramodule that faces a different direction than the camera module. Theprocessor can be configured to receive, from the user input surface, asecond continuous user input. The second continuous user input caninclude a first portion and a second portion. The processor can also beconfigured to control a first imaging operation associated with thesecond camera module based on a first type of input received during thefirst portion of the second continuous user input. The first input typecan include movement of the input element relative to the user interfacesurface. The processor can control a second imaging operation associatedwith the second camera module based on a second input type receivedduring the second portion of the second continuous user input. Thesecond imaging operation associated with the second camera module can bedifferent than the first imaging operation associated with the secondcamera module. In some examples, the first input type received duringthe first portion of the continuous user input operation can bedifferent than the first input type received during the first portion ofthe second continuous user input operation. Further, a receivable rangeof motion to control the first imaging operation based on the firstinput type of the continuous user input operation is different than areceivable range of motion to control the first imaging operation of thesecond camera module based on the first input type of the secondcontinuous user input operation.

In another aspect, a method is disclosed. The method includes,receiving, from the user input surface, a continuous user input. Theuser input includes a first portion and a second portion. The methodalso includes controlling a first imaging operation based on a firstinput type received during the first portion. The first input typeincludes movement of an input element relative to the user inputsurface. The method also includes controlling a second imaging operationbased on a second input type received during the second portion. Thesecond imaging operation is of a different type of imaging operationthan the first imaging operation.

In another aspect, a non-transitory computer-readable storage medium isdisclosed. The non-transitory computer-readable storage medium storesinstructions thereon that when executed cause one or more processors toreceive, from a user input surface, a continuous user input, the userinput including a first portion and a second portion, control a firstimaging operation based on a first input type received during the firstportion, the first input type including movement of an input elementrelative to the user input surface, and control a second imagingoperation based on a second input type received during the secondportion, the second imaging operation being a different type of imagingoperation than the first imaging operation.

In yet another aspect, a device is disclosed. The device includes meansfor receiving, from the user input surface, a continuous user input. Theuser input includes a first portion and a second portion. The devicealso includes means for controlling a first imaging operation based on afirst input type received during the first portion. The first input typeincludes movement of an input element relative to the user inputsurface. The device also includes means for controlling a second imagingoperation based on a second input type received during the secondportion. The second imaging operation is of a different type of imagingoperation than the first imaging operation.

The details of one or more examples are set forth in the accompanyingdrawings and the description below. Other features, objects, andadvantages will be apparent from the description, drawings, and claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A-1C depict an example scene and separate user inputs to controlcamera zoom level and image frame capture operations using a frontfacing camera module.

FIGS. 2A-2C depict an example scene and separate user inputs to controlcamera zoom level and image frame capture operations using a rear facingcamera module.

FIGS. 3A-3F depict examples of devices including camera modules.

FIG. 4 is a block diagram of an example device including a cameramodule.

FIGS. 5A-5E depict example imaging operations controlled in response toa continuous user input.

FIGS. 6A-6C depict another example of imaging operations controlled inresponse to a continuous user input.

FIGS. 7A-7D depict example imaging operations controlled in response touser input provided via a graphical element of a graphical userinterface.

FIGS. 8A-8E depict yet another example of imaging operations controlledin response to user input provided via a graphical element of agraphical user interface.

FIGS. 9A-9E depict an additional example of imaging operations performedin response to user input provided via a graphical element of agraphical user interface.

FIGS. 10A-10C depict an additional example of imaging operationscontrolled in response to user input provided via an input surface of adevice.

FIG. 11 is a flow chart illustrating an example operation forcontrolling a first imaging operation and a second imaging operation inresponse to a continuous user input.

FIG. 12 is a flow chart illustrating another example operation forcontrolling a first imaging operation and a second imaging operation.

DETAILED DESCRIPTION

In the following description, numerous specific details are set forthsuch as examples of specific components, circuits, and processes toprovide a thorough understanding of the present disclosure. The term“coupled” as used herein means connected directly to or connectedthrough one or more intervening components or circuits. Also, in thefollowing description and for purposes of explanation, specificnomenclature is set forth to provide a thorough understanding of thepresent disclosure. However, it will be apparent to one skilled in theart that these specific details may not be required to practice theteachings disclosed herein. In other instances, well-known circuits anddevices are shown in block diagram form to avoid obscuring teachings ofthe present disclosure. Some portions of the detailed descriptions whichfollow are presented in terms of procedures, logic blocks, processingand other symbolic representations of operations on data bits within acomputer memory. These descriptions and representations are the meansused by those skilled in the data processing arts to most effectivelyconvey the substance of their work to others skilled in the art. In thepresent disclosure, a procedure, logic block, process, or the like, isconceived to be a self-consistent sequence of steps or instructionsleading to a desired result. The steps are those requiring physicalmanipulations of physical quantities. Usually, although not necessarily,these quantities take the form of electrical or magnetic signals capableof being stored, transferred, combined, compared, and otherwisemanipulated in a computer system.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. Unlessspecifically stated otherwise as apparent from the followingdiscussions, it is appreciated that throughout the present application,discussions utilizing the terms such as “adjusting,” “causing,”“accessing,” “receiving,” “sending,” “using,” “selecting,”“determining,” “normalizing,” “multiplying,” “averaging,” “monitoring,”“comparing,” “applying,” “updating,” “measuring,” “deriving,”“estimating” or the like, refer to the actions and processes of acomputer system, or similar electronic computing device, thatmanipulates and transforms data represented as physical (electronic)quantities within the computer system's registers and memories intoother data similarly represented as physical quantities within thecomputer system memories or registers or other such information storage,transmission or display devices.

In the figures, a single block may be described as performing a functionor functions; however, in actual practice, the function or functionsperformed by that block may be performed in a single component or acrossmultiple components, and/or may be performed using hardware, usingsoftware, or using a combination of hardware and software. To clearlyillustrate this interchangeability of hardware and software, variousillustrative components, blocks, modules, circuits, and steps aredescribed below generally in terms of their functionality. Whether suchfunctionality is implemented as hardware or software depends upon theparticular application and design constraints imposed on the overallsystem. Skilled artisans may implement the described functionality invarying ways for each particular application, but such implementationdecisions should not be interpreted as causing a departure from thescope of the present disclosure. Also, the example devices may includecomponents other than those shown, including well-known components suchas a processor, memory, equivalents thereof, and the like.

Aspects of the present disclosure are applicable to any suitableelectronic image capture device (such as mobile phones, tablets, laptopcomputers, digital cameras, web cameras, security systems, personaldigital assistants, gaming systems, media players, e-book readers,television platforms, intelligent monitors, an automobile navigationsystems, a wearable device (e.g., a head mounted display, other eyewear,a watch, a sleeve, etc.), and so on) that includes, or has access toimage data from, one or more cameras, and may be implemented inelectronic devices having a variety of camera configurations. Someaspects of the present disclosure can be implemented in or by a devicethat is able to cause a camera to “zoom-in” or “zoom-out” when framing ascene.

As used herein, a “zoom level” may correspond to an effective opticalangle and focal length of an image frame received by one or more camerasat a given zoom level value. For example, the term zoom-in can refer toa relative increase in zoom level as related to an effective opticalangle narrowing and focal length increase as compared to a lower zoomlevel exhibiting a larger effective optical angle and decreased focallength. Further, the term zoom-in can refer to an imaging operation(e.g., a zoom level control operation). Similarly, the term zoom-out canrefer to a relative zoom level lowering or reduction with an effectiveoptical angle being widened and focal length being shortened as comparedto another, higher zoom level. In some examples, a numeric zoom levelmay correspond to a factor that an object in a scene may be enlargedrelative to a received image frame. For example, a 10× zoom level mayresult in an object appearing 10× larger than a default zoom level(e.g., a zoom level of 1×).

Those having skill in the art will understand that an electronic imagecapture device may include a camera module having, for example, a lens,an aperture, and an image sensor. The elements of the camera module canbe controlled to receive and/or capture image frames at a plurality ofdifferent zoom levels. The different zoom levels can be implemented bydigital zoom and/or optical zoom techniques that are well understood inthe art. For example, zoom level can be controlled in a camera moduleincluding a single camera by moving a lens position of the camerarelative to the sensor and/or by digital zoom techniques. Additionally,zoom level can be controlled in camera modules including more than onecamera (e.g., asymmetric dual-camera modules) by applying digital zoomto image data received by a first camera having a fixed focal lengthuntil a transition zoom level is reached, and then transitioning to asecond camera having a different fixed focal length where digital zoomcan then be performed on the image data received by the second camera.In this way, an overall effective range of zoom level for a multiplecamera module can be extended without increasing a z-height dimension ofthe camera module by switching between two or more cameras havingdiffering fields-of-view, optics, and/or sensor sizes.

From these examples, it can be appreciated that there are many optionsand available configurations for adjusting and/or controlling zoom levelin electronic image capture devices. Further, those having skill in theart will appreciate that zoom level control functionality is animportant enabler to a satisfactory user experience when capturing animage frame as described below.

Turning now to FIGS. 1A-1C, an example scene 100 is schematicallydepicted. The scene 100 illustrates a concert with a user 110 in theaudience attempting to capture a “selfie” using a front facing cameramodule 122 of an electronic image capture device 120 (e.g., a mobilephone). The front facing camera module 122 includes a first camera 123and a second camera 125. However, those having skill in the art willappreciate that the example scene 100 depicted in FIGS. 1A-1C can becaptured using a front facing camera module having only a single camera.

As used herein, a “selfie” refers to a self-portrait image framedepicting a user and taken by the user. Similarly, an “usie” or“groupie” can refer to an image frame depicting two or more people withone of the people being responsible for capturing the image frame usingan electronic image capture device. With the increased prevalence ofmobile electronic image capture devices (e.g., mobile phones, digitalstill cameras, tablets, etc.), improved wide area networkfunctionalities, device storage capabilities, and the growing importanceof social media and/or networking, selfies have become more and morepopular. For example, a user may take a selfie to capture, andpotentially share, a current situation of a user, an especiallysignificant moment, and/or a notable occasion. For example, as shown inFIG. 1A, the user 110 may desire to capture a selfie to share a concertexperience with friends, family, and/or social network contacts.Further, the user 110 may desire to capture the selfie so as to reflectand fondly remember and/or reflect back on the scene 100 at a point inthe future. For example, the captured selfie may assist the user 110 inremembering the time he was up front at a concert performed by a belovedartist 130.

Referring now to FIGS. 1A and 1B, it will be appreciated that user skilland/or coordination can be required to compose a scene so as to capturean aesthetically pleasing and/or desirable selfie. For example, asshown, the user 110 is positioning the electronic image capture device120 using a single hand 112. Since a position of the electronic imagecapture device 120 is constrained by a range of possible positions ofthe user's hand 112, it can be difficult to compose a scene that: 1)depicts in the user 110 in a flattering way (e.g., according to aflattering angle that minimizes wrinkles, unpleasant face geometries,etc.); 2) accounts for optimal lighting conditions (e.g., does not washout the foreground or result in a subject that is too dark); and 3)frames the background scene content desired to be captured in the imageframe/selfie.

Further, in addition to the limitations on the location of theelectronic image capture device relative to important portions of thescene (e.g., the user and/or the depicted performing artist 130), theuser 110 is using a thumb 114 from the hand 112 to provide input via agraphical user interface 140. In the FIG. 1B and the figures describedbelow, those having skill in the art will understand that a portion of ahand (e.g., a forefinger, thumb, or other digit) and/or other inputelement (e.g., a stylus) will be illustrated in dashed lines to allowthe reader to visualize the input element over an underlying inputsurface while also enable to reader to visualize the underlying display.That is to say, the dashed line representation of an input elementrepresents that the dashed portion is between an input surface of adisplay of an electronic image capture device and the reader.

As shown in FIG. 1B, the graphical user interface 140 can be displayedover a preview stream rendered on a display 121 of the electronic imagecapture device 120. The graphical user interface 140 can include variousgraphical elements (e.g., icons) to allow the user 110 to provide inputsto control various imaging operations or other functions of the device120. For example, the graphical user interface 140 can include agraphical element 142 that may act as a virtual “shutter” input tocontrol one or more image sensors associated with the camera module 122to capture a received image frame. The graphical user interface 140 canalso include a graphical element that may initiate a video capture modeof a camera application, one or more graphical elements that may beselected to navigate within menus and/or applications. The graphicaluser interface 140 is also shown to include a graphical element 144 thatcan be used to receive an input to adjust a zoom level of the cameramodule 122 (e.g., to adjust a zoom level of the first and/or secondcameras 123, 125).

With continued reference to FIG. 1B, the depicted graphical element 144includes a slider bar that can be selected to receive user input relatedto a desired zoom level of the camera module 122. In the example shown,the slider bar can be adjusted to control a zoom level by sliding aninput (e.g., a touch input or a hovering gesture input) in a leftdirection towards a “−” region of the graphical element 144 to zoom-out.Similarly, the user can provide a sliding right input towards a “+”region of the graphical element 144 to zoom-in. Those having skill inthe art will appreciate that other implementations may be practiced. Forexample, a graphical element can be designed with a slider and toinclude “w” (e.g., wide) and “t” (e.g., telescopic) regions to provideindicia to a user on how a zoom level may be controlled based on adirection of user input movement (e.g., swipe direction). Similarly, thedirections (e.g., left to zoom-out and right to zoom-in) can be reversedin other implementations.

Although the graphical element 144 may be designed as a slider bar orsimilar structure to enable a user to intuit an adjustmenteffect/outcome of different user inputs, those having skill in the artwill appreciate the difficulty in composing a selfie using a zoom leveladjustment graphical user interface element. For example, positioningthe phone with a single hand and using a single digit from that hand toprovide a zoom level input requires a level of coordination to desirablyframe the subject relative to one or more background objects ofinterest. FIG. 1B illustrates an example where the user 110 haspositioned the electronic image capture device 120 to capture the user110 at a flattering angle and where the user 110 has adjusted a zoomlevel of the camera module 122 via the slider bar graphical element 144so as to maximize a size of the user's face that can be captured whilealso framing the performing artist 130.

Turning now to FIG. 1C, an additional complexity in capturing a desiredselfie is schematically illustrated. In FIG. 1C, the user 110 has movedhis thumb a distance d from the graphical element 144 to the graphicalelement 142 to initiate an image capture operation resulting in capturedimage frame 150. However, since the graphical element 144 ispersistently spaced apart from the graphical element 142 along thedisplay 121, an amount of time is required to transition from the zoomlevel adjustment input depicted in FIG. 1B to the image capture inputdepicted in FIG. 1C. As a result, the scene 100 has changed and theperforming artist 130 is only partially framed in the image captured inFIG. 1C. That is to say, although the scene 100 was desirably framed inFIG. 1B, the time required to transition between the zoom leveladjustment at graphical element 142 and the capture input at graphicalelement 144 led to a scene change that resulted in an undesirableframing of the scene 100 (e.g., with the performance artist 130clipped).

Those having skill in the art will appreciate that the time required totransition between the zoom level adjustment in FIG. 1B and the imagecapture input in FIG. 1C can be dependent on the last location of inputalong the slider bar since the location of the graphical element 142 andgraphical element 144 are persistent along the display 121. In this way,after adjusting to a maximum zoom (e.g., to the far right of the sliderbar) a greater distance along the user input surface of the display 121must be covered to transition from a zoom level adjustment to an imagecapture input than the example distance d depicted in FIG. 1C. As aresult, an amount of time and/or user coordination required totransition between user inputs at discrete, stationary graphical userinterface elements 142, 144 can vary depending on the zoom leveladjustment applied at the graphical element 144. Further, attempting toquickly transition between user inputs at different graphical elements(e.g., to rapidly move a position of the thumb 114 as shown betweenFIGS. 1B and 1C) may result in hand shake that unsatisfactorily affectsa framing and/or focus of the scene 100. These complexities in applyinga zoom level adjustment input and attempting to capture an image framecan be especially frustrating to a user when an unsatisfactorilycomposed image frame is captured (e.g., the image frame 150 in FIG. 1C)and when a user is unable to recompose a scene of interest (e.g., aparticularly special moment of the concert depicted in FIGS. 1A-1C)

Turning now to FIG. 2A, another example scene 200 is schematicallydepicted. In this scene 200, a user 210 is attempting to capture inimage frame of a child 232 and a juvenile dog (e.g., puppy) 234 using anelectronic image capture device 220. In contrast to the example scene100 described above with reference to FIGS. 1A-1C, the user 210 in FIG.2A is using a rear facing camera module of the electronic image capturedevice 220 and is able to use a first hand 212 to hold the device. Asshown in FIGS. 2A and 2B, the user 210 is able to use a forefinger 218of a second hand 216 to provide an input via a graphical user interface240. Similar to the graphical user interface 140 illustrated in FIGS. 1Band 1C, the graphical user interface 240 in FIG. 2B is shown to includea graphical element 242 that may be configured to receive a user inputto control an image frame capture operation. Likewise, the graphicaluser interface 240 includes a graphical element 244 that can be used toreceive an input to adjust a zoom level of the camera module. In thisway, the user is able provide input to control a zoom level of thecamera module to maximize a size of the child 232 and the dog 234relative to a preview image displayed on the display 221 of the device220.

In contrast to the example depicted in FIGS. 1A-1C, the example depictedin FIGS. 2A-2C does not require a user to provide graphical userinterface input with a digit from the hand that is primarily used toposition and support the electronic image capture device 220 relative tothe scene 200. That is, the user 210 in FIGS. 2A-2C is able to utilizetwo hands to hold the electronic image capture device and provideimaging operation control inputs via the graphical user interface 240.Nevertheless, the complexities in transitioning between a zoom leveladjustment input of a first type (e.g., a slide adjustment) at thegraphical user interface element 244 and an image capture input at theseparate graphical user interface element of a second type (e.g., atouch or selection) are similarly present in FIGS. 1C and 2C.

Turning now to FIG. 2C, the user 210 is illustrated as providing aninput at graphical element 242 to capture an image frame 250 of thescene 200. However, since the user 210 is required to move hisforefinger a distance d from the graphical element 244 after finalizingthe zoom level adjustment input to the graphical element 242 to providethe image frame capture input, an amount of time and some spatialcoordination is required to transition between user input types. As aresult, although the scene 200 was desirably framed in FIG. 2B, thecaptured image frame 250 in FIG. 2C unsatisfactorily depicts the child232 as looking away from the camera module of the electronic imagecapture device 220. This problem can be especially exacerbating inscenes exhibiting high relative motion and/or when relatively high zoomlevels (zoom-in operations) are applied. As with the user 110 in FIGS.1A-1C, the user 210 may also be frustrated with the lag between FIGS. 2Band 2C and resulting captured image frame 250 that disappointedlyrepresents the scene 200. This experience can be especially frustratingwhen it is not probable that the scene 200 can be recomposed as intendedfor capture. For example, scenes including children and/or animals assubjects can be especially difficult to recreate and/or recompose. Thus,those having skill in the art will appreciate the importance ofdesigning systems and methods to control different imaging operationsbased on user inputs that reduce time lag and/or required coordinationto transition between a first and second imaging operation.

As discussed in more detail below, aspects of the present disclosurerelate to controlling multiple imaging operations of an electronic imagecapture device based on user input received during a user inputoperation. The user input operation can include a first portion and asecond portion with a first type of input received during the firstportion to control a first camera or imaging operation (e.g., to controla zoom-level). A second type of input can be received during the secondportion of the user input to control a second camera or imagingoperation (e.g., to cause the device to capture an image frame). In someembodiments, the user input can be continuous. That is, the firstportion and the second portion can be arranged in temporal series withno interruption and/or intervening portion disposed there between.Further, the first input type can be different from the second inputtype to clearly differentiate between the intended control of the firstimaging operation and the control of the second imaging operation. Inthis way, a user experience when providing input to control differentimaging operations can be improved by minimizing an amount of timeand/or coordination required when transitioning between a first imagingoperation and a second imaging operation.

Additional and/or alternative aspects of the present disclosure relateto causing a display of an electronic image capture device to display agraphical user interface element including, at least, a first region anda second region. The first region can be used to receive a first inputrelated to a first imaging operation (e.g., to control a zoom-level) andthe second region can be used to receive a second input related to asecond imaging operation (e.g., to cause the device to capture an imageframe). In some embodiments, the first input can include movement of aninput element relative to and/or over at least a portion of the firstregion. In these embodiments, the first input can cause a position ofthe second region to move across the display surface relative to thefirst region and/or relative to a location of the input element. Forexample, a position of the second region can track the movement of theinput element. In this way, a transition between the first input at thefirst region and the second input at the second region can be minimizedto enable a user to swiftly shift from a first input to control a firstimaging operation to a second input to control a second imagingoperation in a way that can inhibit scene and/or image compositionchanges during the transition.

Turning now to FIG. 3A, an example electronic image capture device 300is illustrated. The example device 300 includes a “rear-facing” cameramodule 301 including a camera 302. As used herein, the term“rear-facing” may refer to a facing or direction of a camera moduleand/or of one or more associated cameras relative to a primary displayof the device. For example, a primary display of an electronic imagecapture device may provide a preview stream of received image frames tobe used as a virtual “viewfinder” by a user. In this way, a cameramodule receiving light from a scene that faces away from the user and/orthe device may be considered, in some instances, a rear-facing moduleand a camera disposed on an opposite side of the device may beconsidered a “front-facing” module. Those having skill in the art willappreciate that aspects of the present disclosure, as discussed below,can be implemented in conjunction with rear-facing, front-facing, and/orother camera module configurations (e.g., 360 degree capture devices).

Still referring to FIG. 3A, the example device 300 includes a flash unit305 having a first flash element 306 and a second flash element 308. Insome implementations, the first flash element 306 can be a first flashelement type and the second flash element 308 can be the same type offlash element. For example, the first flash element 306 and the secondflash element 308 can each include one or more LEDs. In otherimplementations, the first flash element 306 can be a first flashelement type and the second flash element 308 can be a different type offlash element. In some implementations, the first flash element 306 andthe second flash element 308 can be controlled in concert to regulate anoverall intensity output by the flash unit 305 and/or a colortemperature of output light (e.g., by mixing outputs of each flashelement). A user may provide input, as discussed below, to control theflash unit 305.

Turning now to FIG. 3B, another example electronic image capture device310 is shown. The example device 310 includes a dual camera module 311with a first camera 312 and a second camera 314 arranged in a firstconfiguration. In the first configuration, the first camera 312 isarranged relative to the second camera 314 such that an image framereceived by the first camera represents a first field of view of a sceneand an image frame received by the second camera represents a secondfield of view of the scene that is horizontally adjacent to the firstfield of view when the electronic image capture device 310 is positionedin a portrait mode relative to the scene. FIG. 3C illustrates yetanother example electronic image capture device 320 including a dualcamera module 321. In contrast to the dual camera module 311 of FIG. 3B,the first camera 322 and the second camera 324 in FIG. 3C are spatiallyarranged such that an image frame received by the first camerarepresents a first field of view of a scene and an image frame receivedby the second camera represents a second field of view of the scene thatis vertically adjacent to the first field of view when the electronicimage capture device 320 is positioned in a portrait mode relative tothe scene.

Referring generally to the dual camera modules 311 and 321 of FIGS. 3Band 3C, in some aspects, one of the cameras (such as the first cameras312 and 322) may be considered a primary, main, or master camera, andthe other camera (such as the second cameras 314 and 324) may beconsidered an auxiliary or slave camera. Additionally or alternatively,the second cameras 314 and 324 may have a different focal distance,frame capture rate, spatial resolution, color responsivity, and/orfield-of-view of capture than the first cameras 312 and 322.

FIG. 3D depicts another example electronic image capture device 330having a camera module 331 including a first camera 332, a second camera334, and a third camera 336. In some implementations, two of thecameras, for example, the first camera 332 and the second camera 334,can be configured with different fields-of-view so as to provide anextended overall range of zoom (e.g., by switching between the first andsecond cameras 332, 334 based on zoom level) while the third camera 336may include a sensor responsive to all wavelengths of light (e.g., amono sensor) to enhance color images captured by one or more of thefirst camera 332 and second camera 334. The example device 330 alsoincludes a flash unit 335 having a first flash element 337 and a secondflash element 339. The flash unit 335 can be synchronized with any ofthe first camera 332, second camera 334, and third camera 336 to providefor a flash photography functionality when capturing image frames viaany combination of the cameras.

Turning not to FIG. 3E, yet another example electronic image capturedevice 340 is depicted. As shown, the device 340 includes a cameramodule 341 having a first camera 342. The device 340 also includes adisplay 345. As discussed above, since the display 345 and the cameramodule 341 face a common direction, the camera module 341 can beconsidered in some applications as a front-facing camera module (e.g.,as facing away from a front side of the device 340). In someimplementations, the display 345 can act as a flash element toilluminate a scene facing the display 345 and first camera 342 of thecamera module 341. FIG. 3F illustrates an example electronic imagecapture device 350 including a front facing camera module 351 having afirst camera 352 and a second camera 354. In this way, those havingskill in the art will appreciate that aspects disclosed herein are notlimited to electronic image capture devices provisioned with a specifictype of camera module and the disclosed aspects can be practiced inconjunction with differently oriented cameras (e.g., front-facing,rear-facing, side-facing, 360 capture devices, etc.). Further, aspectsof the present disclosure can be implemented by multiple discretedevices that are communicatively coupled. For example, an image basedsecurity system with access to connected cameras that are separatelylocated can implement aspects of the present disclosure. Similarly, asanother example, a single device, such as any of the example devices300, 310, 320, 330, 340, 350 of FIGS. 3A-3F can implement aspects of thepresent disclosure without receiving image data from a separate device.Thus, it will be understood that while the below description andexamples use the singular term “device” to describe various aspects ofthis disclosure, the term “device” is not limited to a specificconfiguration, type, or number of objects.

FIG. 4 is a block diagram of an example electronic image capture device400. The device includes a first camera 402 and a second camera 404. Asillustrated, the first camera 402 and the second camera 404 are includedas part of a camera module 403. Those having skill in the art willappreciate that FIG. 4 is one example of a device that aspects of thepresent disclosure can be implemented in, and that other devices withdifferent camera configurations can also implement aspects of thepresent disclosure. For example, other devices can include a firstcamera facing a first direction (e.g., rear-facing) and a second camerafacing a second direction (e.g., front-facing) with the first and secondcameras not being included in a common camera module. Of course, otherexample devices can include a single camera or more than two cameras.

Skilled artisans will appreciate that the discussion below related todevice 400 can be applied to the example devices 300, 310, 320, 330,340, 350 of FIGS. 3A-3F, and/or to any other suitable device capable ofcapturing images and/or sequences of image (e.g., video sequences), forexample, wired and wireless communication devices (such as mobilephones, smartphones, tablets, security systems, dash cameras, personalaction cameras, laptop computers, desktop computers, drones,automobiles, wearable devices, head mounted displays, and so on),digital cameras (including still cameras, video cameras, and so on).

In addition to the first camera 402 and the second camera 404, theexample device 400 shown in FIG. 4 includes a processor 406, a memory408 storing instructions 410, a camera controller 412, a display 416,and a number of input/output (I/O) components 418. The device 400 alsoincludes a flash unit 425. The device 400 may include additionalfeatures or components not shown. For example, a wireless interface,which may include a number of transceivers and a baseband processor, maybe included for a wireless communication device. Device 400 may includeadditional cameras other than the first camera 402 and the second camera404. The disclosure should not be limited to any specific examples orillustrations, including example device 400. Those having skill in theart will appreciate that the example device 400 can be used fortraditional photographic and video applications, high dynamic rangeimaging, panoramic photo and/or video, and stereoscopic imaging, forexample.

The first camera 402 and second camera 404 may be capable of capturingindividual image frames (such as still images) and/or capturing video(such as a succession of captured image frames). The first camera 402and second camera 404 also may include one or more image sensors (notshown for simplicity), lenses, actuators, and/or shutters for receivingan image frame and providing the received image frame to the cameracontroller 412.

The memory 408 may be a non-transient or non-transitory computerreadable medium storing computer-executable instructions 410 to performall or a portion of one or more operations described in this disclosure.The device 400 may also include a power supply 420, which may be coupledto or integrated into the device 400.

The processor 406 may be one or more suitable processors capable ofexecuting scripts or instructions of one or more software programs (suchas instructions 410) stored within memory 408. In some aspects, theprocessor 406 may be one or more general purpose processors that executeinstructions 410 to cause the device 400 to perform any number ofdifferent functions or operations. In additional or alternative aspects,the processor 406 may include integrated circuits or other hardware toperform functions or operations without the use of software. While shownto be coupled to each other via the processor 406 in the example of FIG.4, the processor 406, memory 408, camera controller 412, the display416, and I/O components 418 may be coupled to one another in variousarrangements. For example, the processor 406, memory 408, cameracontroller 412, the display 416, and/or I/O components 418 may becoupled to each other via one or more local buses (not shown forsimplicity).

The camera controller 412 may include an image signal processor 414,which may include a single processing resource that is shared by thefirst camera 402 and the second camera 404. Optionally, the image signalprocessor 414 can include a first image signal processor 415 that isconfigured to process image data received from the first camera 402, andthe image signal processor 414 can include a second image signalprocessor 417 that is configured to process image data received from thesecond camera 404. Thus, it will be understood that some configurationsmay include a dedicated image signal processor for each of the firstcamera 402 and the second camera 404, and in other configurations thefirst camera and the second camera 404 may be coupled to a common imagesignal processor 414.

In some aspects, the image signal processor 414, or optionally firstimage signal processor 415 and/or second image signal processor 417, mayexecute instructions from a memory (such as instructions 410 from memory408 or instructions stored in a separate memory coupled to the imagesignal processor 414) to control operation of the cameras 402 and 404.In other aspects, the image signal processor 414 may include specifichardware to control operation of the cameras 402 and 404. The imagesignal processor 414 may alternatively or additionally include acombination of specific hardware and the ability to execute softwareinstructions. Moreover, in other implementations, the camera controller412 can include a first camera controller 403 configured to control thefirst camera 402, and a second camera controller 405 configured tocontrol the second camera 404. In this way, the first and second cameras402, 404 can be controlled by a single controller module and/or byseparate controller modules disposed within the camera controller 412.

In some example implementations, the camera controller 412 may receiveinstructions from the processor 406 and control operation of the firstcamera 402 and the second camera 404, and/or operation of the imagesignal processor 414 (or first and second image signal processors 415and 417). For example, the processor 406 may receive image frame dataprocessed by the image signal processor 414 and determine one or moreimage capture settings including automatic exposure control (“AEC”),automatic focus (“AF”), automatic white balance (“AWB”), and flash unitsettings for an upcoming frame based on the received image frame data.In some implementations, the processor 406 can activate the flash unit425 to emit a pre-flash for use in determining AEC, AF, and/or AWBsettings for an upcoming image frame to be captured using a full flashintensity emitted by the flash unit 425. Based on the determined imagecapture settings, the processor 406 may provide instructions to thecamera controller 412. These instructions may include camera settings tobe applied by the first camera 402 and/or second camera 404 such asexposure, sensor gain, etc., and may include digital image processinginstructions to be applied by the image signal processor 414.

With continued reference to FIG. 4, the processor 406 and/or cameracontroller 412 can control a zoom level of the camera module 403. Asused herein, a zoom operation may refer to an operation that results ina zoom level adjustment in response to a control signal. For example, azoom operation can be initiated automatically based on a sceneclassification, object detection and/or recognition, and/or based onother techniques. Alternatively or additionally, a zoom operation can beinitiated to adjust a zoom level setting of the camera module 403 inresponse to user input. Additionally, the processor 406 and/or cameracontroller 412 can control other imaging operations of the electronicdevice 400. For example, the camera module 403 may be controlled tocapture one or more still images and/or a sequence of video based onuser input and/or in response to automated control signals (e.g.,control signals that control an imaging operation without requiring auser input).

As illustrated, the flash unit 425 of the device 400 can include one ormore flash elements. For example, the flash unit 425 can include a firstflash element 426 and a second flash element 428. The processor 406 canbe configured to transmit signals to the flash unit 425 via the cameracontroller 412 to control the first flash element 426 and/or secondflash element 428 as part of a flash photography operation. In someexamples, a flash photography operation can optionally be initiated inresponse to a user input or selection.

In some implementations, the processor 406 can be configured to controlthe display 416 to display a captured image, or a preview of one or morereceived images, to a user. The display 416 may also be configured toprovide a viewfinder or bounding box when displaying a preview image foruse by a user prior to capturing an image frame of a scene. For example,a bounding box may be used to identify one or more faces in a scene canbe used to control AF operations. Additionally, the processor 406 can beconfigured to control the display 416 to emit light during an imagecapture operation in conjunction with a flash instruction. That is tosay, although depicted as a separate functional block in the exampledevice 400, those having skill in the art will appreciate that thedisplay 416 can optionally be used as a flash element of the flash unit425.

The display 416 may be any suitable display or screen allowing for userinteraction and/or to present items (such as captured images and video)for viewing by a user. In some aspects, the display 416 may be atouch-sensitive display that incorporates one or more (including all) ofthe I/O components 418. For example, the display 416 can include a userinput surface such as a resistive touch screen, a surface acoustic wavetouch screen, a capacitive touch screen, or other similar technology.The display 416 may include underlying or adjacent liquid crystaldisplay elements, dot matrix display elements, light emitting diodeelements, organic light emitting diode elements, e-ink elements,interferometric modulator elements, and/or other display elements. Inthis way, the display 416 may be configured to provide a preview streamof image frames received by the camera module 403 and receive user inputon a surface that is disposed over the preview stream.

In addition to the examples provided above, the I/O components 418 maybe or include any suitable mechanism, interface, or device to receiveinput (such as commands) from the user and to provide output to theuser. For example, the I/O components 418 may include (but are notlimited to) a graphical user interface displayed by the display 416 andincluding one or more icons or graphical elements, keyboard, a mouse, amicrophone and speakers, electro-mechanical buttons and inputmechanisms, and so on. In some examples, the I/O components 418 canreceive tactile (e.g., touch inputs) from a user and/or an input element(e.g., a stylus, pen, finger or other hand digit, etc.) and/or receivenon-tactile (non-touch inputs). For example, the I/O components 418 maysense hover inputs and/or 3D gestures using active depth sensingtechnologies. In this way, a user may provide input by physicallycontacting an input surface of the I/O components 418 (e.g., an inputsurface of the display 416) and/or may provide an input to adjust one ormore aspects of an imaging operation performed by the electronic imagecapture device 400 using non-touch input types.

Turning now to FIGS. 5A-5E, example imaging operations performed by anelectronic image capture device 520 are illustrated. While FIGS. 5A-5Ediscuss example zoom level control and image capture operations inresponse to different portions of a single user input, those havingskill in the art will appreciate that other imaging operations may beperformed by the electronic image capture device 520 in response to theuser input. For example, flash photography, camera module selection,auto focus, imaging mode (e.g., HDR, low light, video, high frame ratemode, etc.), imaging filters, and the like can be controlled by theelectronic image capture device 520 in response to any of the exampleuser input operations described herein.

Referring to FIG. 5A, the electronic image capture device 520 isillustrated as being held by a first hand 512 of a user during animaging operation. The electronic image capture device 520 includes afront facing module 501 including a first camera 502 and a second camera504. The electronic image capture device 520 includes a rear facingmodule (not visible in FIG. 5A) that is receiving image frames that arebeing displayed in a preview stream on a display 521. As shown, thepreview frames or preview stream depict a subject 581 engaging in abodyboarding activity in an aquatic environment.

Still referring to FIG. 5A, a second hand 516 of the user is positioningan input element 518 that is being used to provide a touch input (e.g.,a contact or tactile input) at a position 573 of an input surface of thedisplay 521. The input surface of the display 521 is disposed along anx-y plane as defined by the illustrated reference coordinate system. Inthe example shown, the input element 518 includes a forefinger of thehand 516. Of course, those with skill in the art will appreciate thatother fingers and/or digits can be utilized as input elements, and thatother non-anatomical structures can be utilized as input elements topractice aspects of the present disclosure (e.g., styluses, controllers,wands, etc.).

In this example, the display 521 outputs a graphical user interfaceincluding graphical element 542 and other graphical elements. However,the position 573 of touch input utilized by the user can be selected asanywhere on the input surface of the display 521. That is to say, a usermay determine a position to initiate the user input described withreference to FIG. 5A so as to select a convenient or desired location onthe display 521. Of course, the example in FIGS. 5A-5E may also bepracticed by providing a graphical element (not shown) dictating alocation of touch input to initiate the user input and resulting imagingoperations discussed below. Further, while the example in FIG. 5Aillustrates a touch input at position 573 by the input element 518,those having skill in the art will understand that aspects of thisdisclosure can be practiced using non-touch inputs (e.g., using inputstructures such as image sensors, ultrasound sensors, active depthsensors, etc. that do not require touch).

Turning now to FIG. 5B, the input element 518 has moved about theposition 573 of the display 521 in a clockwise direction so as toprovide a zoom level control input. That is to say, the input element518 has maintained in contact with the display 521 at position 573 and acontacting surface of the input element 518 has twisted, turned, orrevolved, and possibly translated, relative to the x-y plane about az-axis of the example reference coordinate system. In some embodiments,the twisting or turning of the input element 518 relative to the inputsurface of the display 521 can be tracked, for example, by monitoring aconnected component of touched pixels and monitoring the shape of theconnected component in a frame-by-frame read. For example, an initialtouch (e.g., the touch of FIG. 5A) can result in a connected componentor blob of sensed pixels in an underlying touch-sensitive array, andmonitoring a shape of the connected component from a first frame to asubsequent frame can provide an indication of a twist based on a changeof the center of mass of the blob and/or by monitoring peripheral pixelsof the blob (e.g., by monitoring a movement of a periphery of the blob).In this way, a center of a touch point can translate frame-by-frame asthe input element 518 rotates or twists so as to not require a perfectrotation of the initial center of touch about the z-axis of thereference coordinate system. That is to say, the twist input does nothave to be centered absolutely on an axis.

In another embodiment, the blob monitoring can be simplified byidentifying a maximum x-y dimension of a bounding box of the blob andmonitoring the displacement of one, or both, of the dimensions relativeto the x-y coordinates in a frame-by-frame fashion to track relativetwisting. Of course, those having skill in the art will appreciate thatother techniques (e.g., monitoring input pressure) can be applied todetermine a twisting motion of the input element 518.

Referring to FIGS. 5B and 5C, this “twisting” motion forms a firstportion of the user input illustrated in FIGS. 5A-5D and can be used tointuitively control a zoom-level of the electronic image capture device520. As shown, the subject 581 in the received preview stream isenlarged relative to the display 521 between FIGS. 5A and 5B, andfurther between FIGS. 5B and 5C as a result of the twisting inputprovided between the initialization of the input at FIG. 5A and theselected zoom level illustrated in FIG. 5C. FIGS. 5A-5C depict a zoomlevel increase in response to the illustrated clockwise twisting inputsince standard convention in threaded fasteners results in tightening(e.g., zooming in or increasing zoom level) in this rotationaldirection. However, the direction of zoom level control can be designedto react in an opposite fashion (e.g., to zoom-out when clockwise touchinput is received) and/or can be selected by a user based on preference.

Referring now to FIG. 5D, a second portion of the user input isillustrated. The second portion of the example user input includes arelease of the twisting touch input shown in FIGS. 5A-5D. For example,FIG. 5D illustrates a separation 579 (hatching) between the inputelement 518 and position 573 of the input surface of the display 521.This release can be used to control an image capture operation asrepresented by the stylized hatching of the captured image frame 550shown on the display 521. In this way, the user is able to provide asingle user input including a first portion (twisting touch motion) tocontrol a zoom level of the rear facing camera and release the touchinput during a second portion to control an image capture operation. Inother embodiments, the second portion can include an alternative type oftouch input. For example, the input type during the second portion caninclude a release (as illustrated), a translation of the input elementacross the display 521, a steady touch (e.g., a long touch), a pressurevarying touch, etc. As a result, the user can seamlessly transitionbetween the two example imaging operations using a single input andwithout being required to transition between separate graphical userinterface elements displayed at separate locations along the display521. Thus, the user is able to initiate the capture operation muchfaster, and with less required coordination, once the desired zoom levelis reached than the example operations depicted in FIGS. 1 and 2.

Although the first portion and second portion of the single user inputdescribed above with reference to FIGS. 5A-5D can be consideredcontinuous since the touch input of the first portion and the release ofthe touch input of the second portion are arranged in temporal serieswith no interruption and/or intervening portion or input types disposedthere between, those having skill in the art will appreciate that insome embodiments described below, a continuous user input can includemore than two portions with at least one portion allowing a user tomaintain an input related to a first imaging operation whiletransitioning to provide an input related to a second imaging operation.Moreover, it will be understood that while the input provided by theinput element 518 is continuous between FIGS. 5A-5C, it will beunderstood that the movement exhibited by the input element 518 duringthe first portion need not be continuous. That is, the first portion ofthe example user input can include a continuity of a touch input withpauses and intermittency of movement of the user input element relativeto the input surface of the display 521.

Turning now to FIG. 5E, an initiation of a second user input to controlzoom level and image capture operations is illustrated. In this example,the user has caused the electronic image capture device 520 to completethe image capture operation depicted in FIG. 5D (as a result of therelease of the touch input) and has provided a second touch input viainput element 518 at a second position 574 of the input surface of thedisplay 521. In order to capture a second image frame depicting thesubject 581 and the scene at a lower zoom level than was used to capturethe image in FIG. 5D (e.g., to zoom-out) the user has twisted the inputelement 518 at the second position 574 relative to the display 521 in acounter-clockwise direction. As a result, a zoom-out operation has beenperformed by the device 520 and the subject 581 displayed in FIG. 5E issmaller relative to the display 521 than in the image frame captured inthe preceding user input depicted in FIGS. 5A-5D. Hence, it will beappreciated that opposing directions of movement during a first portionof a user input can result in different adjustments to zoom level.

Referring generally to FIGS. 5A-5E, while the depicted exampleillustrates an intuitive mechanism to control two or more imagingoperations via a single, continuous user input, in some aspects it maybe desirable to control a first imaging operation during the firstportion of the input in accordance with an expected range of comfortablemovement by the user. For example, when a twisting input type isproviding during the first portion of the user input to control a zoomlevel, it may be desirable to set a zoom level maximum and a zoom levelminimum relative to a comfortable range of motion that may be expectedby the user. In some cases, this range can be based on the type of inputelement. For example, when a finger is utilized as the input element, arange of comfortable rotation or twisting of the input element relativeto the display 521 may be less than 360 degrees. For example, it may becomfortable for a user to twist a forefinger of one hand in a range ofbetween 45 degrees and 270 degrees. In another example, it may becomfortable for a user to twist a thumb of one hand in a more restrictedrange of motion. For example, a thumb may be comfortably twisted in arange of 45 degrees, or less, relative to the display 521 when a handassociated with the thumb is utilized to hold the electronic imagecapture device 520. In this way, the zoom level control can be adjustedbased on a range of twist or rotational movement of the input elementthat is less than 360 degrees. Further, a different range may be used tocontrol a zoom level of a rear facing camera module as compared to arange used to control a zoom level of a front facing module sincedifferent types of input elements may commonly be used with each module(e.g., thumb for front facing selfie and forefinger for rear facingcamera module zoom level control). In this way, a zoom level controlresponsivity can vary depending on the overall range set for twistinput. Hence, a 15 degree twist applied when using a front facing cameramodule of an electronic image capture device can result in a differentoverall change in zoom level as compared to a 15 degree twist appliedwhen using a rear facing camera module of the same electronic imagecapture device since different bounds of a zoom level control range maybe set for the different camera modules.

FIGS. 6A-6C schematically depict another example of a user input thatcontrols different imaging operations performed by an electronic imagecapture device 620. The electronic image capture device 620 is supportedby a first hand 612 of a user. The electronic image capture device 620also includes a display 621 having a user input surface and outputting apreview stream of image frames depicting a scene. The scene includes asubject 681 depicted as a child preparing to a strike a baseballdisposed on a baseball training device. The display 621 is alsoillustrated as outputting a graphical element 691 of a graphical userinterface. The graphical element 691 includes a first region 693 and asecond region 695. In this example, the user input can include a firstportion which commences after a touch input is provided by an inputelement 618 at the graphical element 691.

In the example illustrated in FIG. 6A, the input element 618 includes aforefinger of a second hand 616 of the user. Of course, it will beappreciated that the input element 618 can include other forms. Further,it will be appreciated that the location of the graphical element 691can be persistent relative to the display 621. That is, the position ofthe graphical element 691 can be set so as to appear at a commonlocation along the input surface of the display whenever a cameraapplication is in use. Alternatively, the graphical element 691 canappear in response to a touch input at any position along the inputsurface of the display. In this way, a user may determine a location forthe graphical element 691. For example, a user can place the a touchinput at a location on the display so as to position the graphicalelement 691 in a location that does not occlude a region of interest ofa preview frame.

Turning now to FIG. 6B, the user has maintained the touch input via theinput element 618 that was initiated in FIG. 6A, and has moved the inputelement relative to the display 621. The movement of the input element618 between FIGS. 6A and 6B can be characterized as a twisting orrotational movement relative to the input surface of the display 621.The twisting or rotational movement of the input element 618 can beobserved by comparing positions of the input element 618 in FIGS. 6A and6B. Additionally, the graphical element 691 has rotated about the x-yplane of the input surface between FIGS. 6A and 6B to provide feedbackto the user related to the movement of the input element 618 as sensedby the electronic image capture device 620. More specifically, thesecond region 695 of the graphical element 691 has moved in a clockwisedirection about the perimeter of the first region 693 to provide indiciaof the sensed movement of the input element 618. Those having skill inthe art will appreciate that the arrangement of the first region 693 andthe second region 695 can be intuited by a user as a virtual dial thatis responsive to a twisting input. Further, it will be understood thatthe graphical element 691 is one example of a virtual or graphical dialand that other geometries, shapes, or arrangements of graphical elementscan be utilized in accordance with aspects of the present disclosure.

Still referring to FIG. 6B, the first portion of the user inputillustrated as the movement of the input element 618 between FIGS. 6Aand 6B can be used to control a zoom level of a rear facing cameramodule of the electronic image capture device 620. For example, thesubject 681 is enlarged relative to the display 621 in FIG. 6B ascompared to FIG. 6A.

Referring now to FIG. 6C, a second portion of the user input is shown.The second portion includes a release of the input element 618 asillustrated by an emphasized separation 679 disposed between the display621 and the input element. The second input type of a release conductedduring the second portion of the user input controls a different imagingoperation than the first type of user input (twisting) conducted duringthe first portion of the user input illustrated described with referenceto FIGS. 6A and 6B. In this illustrated example, the release controls animage capture operation depicted by the stylized hatching of thecaptured image frame 650 presented on the display 621 in FIG. 6C. Asdiscussed above with reference to FIG. 5D, in other embodiments, thesecond portion can include an alternative type of touch input. Forexample, the input type during the second portion can include a release(as illustrated), a translation of the input element across the display621, a steady touch (e.g., a long touch), a pressure touch, etc. In thisway, the user is able to conduct a single, continuous user input tocontrol a zoom level of the rear facing camera module of the electronicimage capture device 620 before smoothly transitioning to control animage capture operation in a way that does not require a repositioningof the input element 618 along the x-y plane. As a result, the user isable to more quickly capture an image frame depicting the subject asdesired after the zoom level control adjustment as compared to theexamples depicted in FIGS. 1 and 2.

FIGS. 7A-7D illustrate another example of a user input that controlsdifferent imaging operations performed by an electronic image capturedevice 720 via a graphical user interface. The example user input beginsin FIG. 7A with a touch between an input element 717 and an inputsurface of a display 721. The touch input is provided at a location 773on the display 721 and in this example the input element 717 includes athumb. The thumb is associated with a hand 716 that is supporting theelectronic image capture device 720 so as to frame an image of the user781A and a second subject 781B situated in close proximity to the user781A via a front facing camera module 701 of the device. In this way,FIG. 7A can be considered as depicting an example of a selfie, usie, orgroupie capture operation and highlights the aforementioned complexitiesin adjusting different imaging operations using a digit of a hand thatis also used to support and position the device 720. The front facingcamera module 701 includes a first camera 702 and a second camera 704.However, in other embodiments the example operation described withreference to FIGS. 7A-7D can be implemented in differently provisionedelectronic image capture devices (e.g., using a rear facing cameramodule and/or using differently configured front facing camera modulesthan the example depicted in FIG. 7A).

Still referring to FIG. 7A, the location 773 of the touch input can beselected by the user 781A. That is, in some implementations, the user781A can initiate the example user input by touching any location alongthe input surface of display 721. In other implementations, a graphicaluser interface may dictate a location of the touch input describedbelow. That is to say, the display may persistently present one or moregraphical user interface elements setting a location of touch input tocontrol one or more imaging operations (e.g., a zoom level controland/or image frame capture control). In other implementations, asub-portion of the input surface of the display 721 may be utilized toreceive the touch input shown in FIG. 7A. For example, the electronicimage capture device 720 can be configured to enable the user 781A toprovide the input depicted in any location bounded within a lower half,upper half, quadrant, right most half, left most half, etc. of thedisplay 721.

Referring now to FIG. 7B, once the touch input depicted in FIG. 7A isreceived, a graphical element 791 may be displayed at or near thelocation 773 of the touch input. In some embodiments, the graphicalelement 791 can be displayed once a threshold length of time of thetouch input has been met. For example, the graphical element 791 can beconfigured once the initiated touch input has persisted for 0.5 seconds,or another amount of time that can indicate an intended touch orpersistent touch. In any case, the graphical element 791 can include afirst region 793 and a second region 795.

Referring now to FIGS. 7B and 7C, a zoom level of the camera module 701can be controlled in response to a movement of the input element 717relative to the first region 793 during a first portion of the userinput described with reference to FIGS. 7A-7D. For example, a location796 of the touch input on the first region 793 in FIG. 7B is differentthan a location 798 of the touch input on the first region in FIG. 7C.In some embodiments, the movement of the input element 717 relative tothe first region depicted in FIGS. 7B and 7C can include a continuoustranslated touch input (e.g., a drag) across the display 721 along anarc. In other embodiments, the movement can include a transition from afirst touch to a second touch with a separation of the input element 717from the display 721 there between. In this way, the first region 793 ofthe graphical element 791 can act as an arced slider or virtual dial toallow the user 781A to provide a zoom level control input via agraphical user interface.

In some implementations, an initial zoom level upon the initializationof the camera module 701 can be disposed evenly between a minimum andmaximum zoom level that the camera module 701 can be controlled to. Insuch implementations, the graphical element 791 can be initiallydisplayed such that a position of the initial touch input relative tofirst region 793 is between the relative ends of the illustrated arc. Inother implementations, a default zoom level may be fully zoomed out(wide level) or fully zoomed in (tele level) and the graphical element791 can be rendered accordingly such that it is convenient for the userto provide input to control the zoom level via the first region 793, ifneeded.

Turning now to FIG. 7D, a location 799 of touch input by the inputelement 717 has moved to the second region 795 of the graphical element791 as compared to the location 798 shown in FIG. 7C. In this way, thosehaving skill in the art will appreciate that a second portion of theuser input described with reference to FIGS. 7A-7D can include a secondmovement of the input element 717 between the first region 793 and thesecond region 795. This second movement during the second portion of theuser input can be provided to control an image capture operation once adesired zoom level has been reached based on the first portion of theuser input. For example, as shown in the captured image frame 750rendered on the display 721 in FIG. 7C, the user 781A and the secondsubject 781B are framed in the scene such that they are enlargedrelative to FIG. 7A and such that the background stage at the depictedvenue is also framed within the image frame 750. In some embodiments,the user 781A can maintain a touch input at the second region 795 aftermoving the input element from the first region 793 to the second regionto trigger a burst capture of multiple still image frames and/or totrigger a video capture mode.

In some embodiments, the movement of the input element 717 between FIGS.7C and 7D can include a translated, continuous touch input (e.g., adrag) along the display 721 along a line segment extending between thelocation of touch input depicted in FIG. 7C and the location of touchinput depicted in FIG. 7D. In this way, the first portion (e.g., FIGS.7A-7C) of the user input to control the zoom level and the secondportion (e.g., FIGS. 7C-7D) of the user input can form a continuoustouch input including at least two translations. That is to say, thefirst portion and the second portion can be arranged in temporal serieswith no interruption and/or intervening portion there between. As aresult, a time and level of coordination required to transition betweena zoom level control input (e.g., the first portion) and an imagecapture control input (e.g., the second portion) can be minimized ascompared to the examples described with reference to FIGS. 1 and 2. Ofcourse, in other embodiments, the movements depicted in FIGS. 7B-7D neednot be continuous touch translations (e.g., one or more drags along thedisplay) and the first portion and the second portion can be arrangedwith intervening portions there between so as to not be arrangeddirectly in temporal series.

FIGS. 8A-8E schematically depict another example of imaging operationsperformed in response to a user input provided via a graphical userinterface. FIG. 8A illustrates an electronic image capture device 820being held by a hand 816 of a user 881A. Similar to FIGS. 7A-7D, FIG. 8Aillustrates an example of image frame capture operation using a frontfacing camera module 801 having a single camera 802 configured toreceive image frames depicting the user 881A and a young child 881B.

FIG. 8B shows a touch input on the input surface of the display 821provided by the input element 817. In response to the touch input, agraphical element 891 is rendered. For discussion purposes, onlygraphical element 891 is shown in FIGS. 8B-8E. However, it will beunderstood that the electronic image capture device 820 can beconfigured to output a graphical user interface including additionalgraphical elements. For example, a graphical user interface can beprovided to receive touch inputs related to other imaging and/or devicecontrol operations than the examples discussed herein.

Still referring to FIG. 8B, the graphical element 891 includes a firstregion 893, a second region 895, and a third region 894. The firstregion 893 includes a slider bar and the third region 894 includes asliding indicator. The slider bar and the sliding indicator can be usedto receive an input to control a zoom level. For example, a touch inputcan move between positions along the slider bar to adjust a zoom levelof the camera module 801 between a minimum zoom level (“−” or “w”) and amaximum zoom level (“+” or “t”). Similarly, the sliding indicator of thethird region 894 can provide feedback to the user regarding a locationalong the display 821 of sensed touch input and/or of a current zoomlevel applied relative to a range of zoom level control. In someimplementations, a continuous touch input can be applied to move thethird region 894 relative to the first region 893 (e.g., a draggesture). In other implementations a zoom level can be adjusted byproviding discrete touch inputs along the slider bar (e.g., separatetouch inputs). Persons with skill in the art will appreciate that otherinput types (e.g., non-touch gestures) can be received to adjust a zoomlevel via the slider bar and sliding indicator.

Turning now to FIG. 8C, a position of the received touch input along theslider bar of the first region 893 as indicated by the sliding indicatorof the third region 894 has moved relative to the position shown in FIG.8B. Specifically, the sliding indicator is positioned closer to theminimum zoom level as compared to the position of touch input along theslider bar in FIG. 8B. As a result, a zoom level of the preview imagerepresented on the display 821 has decreased in FIG. 8C. Further, aposition of the second region 895 has also moved between FIG. 8B inresponse to the change in touch position. FIG. 8D shows yet anotherposition of the received touch input along the slider bar of the firstregion 893. In this figure, the sliding indicator of the third region894 is positioned closer to the maximum zoom level as compared to theposition of the touch input along the slider bar in FIG. 8B. Thus, azoom level of the preview image on the display 821 has increased in FIG.8D relative to FIGS. 8C and 8B.

In some embodiments, the second region 895 can include a capture orshutter graphical element that can receive an input from the user 881Ato cause the camera module 801 to capture an image frame. As discussedthroughout this disclosure, it can be desirable to provision a userinterface of an electronic image capture device so as to limit an amountof time and/or coordination required by a user to transition betweeninput types that control separate imaging operations. For example, itcan be desirable in some embodiments to limit a distance between a firstregion of a graphical element that can be used to control a firstimaging operation and a second region of the graphical element that canbe used to control a second, and different, imaging operation. Further,it can be desirable to maintain a spatial relationship between inputareas of different regions of a graphical element such that a commondirection of motion is available at all times to transition from thefirst region to the second region (e.g., to transition between input toadjust different imaging operations affected by the separate regions ofthe graphical element).

Referring now to FIGS. 8C and 8D, it can be observed that a location ofthe second region 895 of the graphical element 891 moves in response toa change in location of the slider indicator of the third region 894. Inother words, the second region 895 moves in concert with the thirdregion 894 relative to the first region 893 based on a location of thetouch input received from the input element 817 by the display 821. As aresult, an x-y coordinate distance between the sliding indicator of thethird region 894 and the second region 895 is maintained over timeregardless of where the sliding indicator is positioned relative to theslider bar of the first region 893. Moreover, a relative direction inthe x-y plane between the sliding indicator and the second region 895 isalso persistent even as the sliding indicator moves along the sliderbar. That is to say, the second region 895 is updated along with, andtracks the position of, the third region 894 such that it is alwaysdirectly below (in a y-axis dimension) the sliding indicator. In someembodiments, a distance and/or direction between the second region 895and the third region 894 can be selected and/or adjusted by a user. Forexample, a user may prefer an upward swipe or directional relationbetween the regions. Additionally, a user may adjust a distance toreduce a required time to transition between the two regions and/or toincrease a distance so as to inhibit inadvertent selection.

Turning now to FIG. 8E an advantage and improved user experienceprovided by the movement of the second region 895 relative to the firstregion 893 can be observed. In this figure, the user 881A has moved theinput element 817 to provide a touch input at the second region 895. Insome examples, the electronic image capture device 820 can be configuredto cause the camera module 801 to capture an image frame 850 in responseto the touch input at the second region 895. In other examples,additional or alternative imaging operations can be controlled inresponse to the user input via the second region 895 of the graphicalelement 891. In any case, because the movement of the second region 895between FIGS. 8B and 8D tracks the touch input represented by thesliding indicator, a distance d between the third region and the secondis maintained throughout the user input operation. In this way, anamount of coordination and time required to transition between the firstinput to control the zoom level (FIGS. 8B-8D) and a second input tocontrol the image capture (FIG. 8E) can be reduced as compared to theexamples discussed above with reference to FIGS. 1 and 2. As a result, auser of the device depicted in FIGS. 8A-8E is more likely to capture animage frame as intended because it is less likely that the scene changesbetween the first input and the second input and/or because hand shakecan be limited due to a reduction in coordinational complexity.

In contrast to the example of FIGS. 7A-7D, the user 881A in FIGS. 8A-8Eis holding the electronic image capture device 820 in a portrait modeconfiguration so as to frame himself, the young child 881B, and a regionof interest of a background portion of the scene (e.g., an infield of abaseball field positioned behind the child 881B and user 881A). Thosehaving skill in the art will appreciate that since an x-axis coordinateof the center of mass of the device 820 is disposed squarely withinx-axis coordinate boundaries of the user's hand 816, it may be easier tomove the thumb of the hand in a greater range of motion than in theexample of FIGS. 7A-7D (with the device in landscape modeconfiguration). That is, an effect of a moment applied on the center ofmass of the user's hand by the movement of the thumb (e.g., inputelement 817) is reduced by the balance of the device 820. As a result, agreater range of motion of an input element 817 relative to the display821 can be utilized to control a first imaging operation withoutincreasing a level of manual dexterity and/or coordination required bythe user 881A as compared to the implementation depicted in FIGS. 7A-7D.For example, a maximum translation dimension of the slider bar of thefirst region 893 can be higher than a maximum arc length of the firstregion 793 in FIGS. 7B-7D since it may be easier for a user to move athumb in a greater range of motion when holding a device in a portraitconfiguration. Similarly, the arc shape of the first region 793 depictedin FIGS. 7B-7D may facilitate a translation length that is morecomfortable to provide input over by a user than the same lengtharranged in a linear dimension since an x-axis minimum and a x-axismaximum of the arc shape may be closer to each other than the x-axisminimum and x-axis maximum of an equal linear translation span.

Continuing to compare the examples depicted in FIGS. 7 and 8, in someembodiments a region of a graphical element can be spaced apart fromanother region of the graphical element along an input surface such thatthe regions are not contiguous and/or do not abut one another along theinput surface. For example, as illustrated in FIG. 8E the first andsecond regions 893, 895 are spaced apart from the third region 894 alongthe surface of the display 821 by a distance d. In some implementations,the spatial position and/or arrangement of regions of the graphicalelement can be selected to inhibit inadvertent contact or selection by auser. For example, by spacing the first and second regions 893, 895apart from the third region 894, a user may more easily provide inputvia the first and second regions (e.g., to control a zoom level) withoutinadvertently contacting the third region 894 so as to provide inputrelated to a separate imaging operation (e.g., to control a capture ofan image frame). Those having skill in the art will appreciate that thisselection can be applied to any of the embodiments disclosed herein. Forexample, although the first region 793 of the graphical element 791 inFIG. 7B abuts the second region 795 of the graphical element, thosehaving skill in the art will appreciate that the first and secondregions can be optionally spaced from one another along the surface ofthe display 721. Similarly, the responsivity to input of the touch stackcan vary across the regions of the graphical element 791. In this way, aportion of the first region 793 that is proximate to the second region795 can be less responsive or sensitive to user input than a more distalportion of the first region 793.

Those having skill in the art will appreciate that, in someimplementations, it may be undesirable to receive an input to control animaging operation (e.g., to control a zoom level) via a twist orrotation of an input element when using a front facing camera modulesince a common input element in such applications may be a thumb of auser, and it can be difficult to twist a thumb relative to an inputsurface while supporting a device with the hand of the thumb. Thus, insome aspects of the present disclosure, an electronic image capturedevice can be configured to receive different types of user inputs tocontrol a common imaging operation (e.g., to control a zoom level)depending on which camera module is being utilized. For example, a firstinput type (e.g., a twist as depicted in FIG. 5 or 6) can be received tocontrol a zoom level when a rear facing camera module is receiving imagedata and a second input type (e.g., a linear or non-linear translationas illustrated in FIGS. 7 and 8) can be received by the device tocontrol a zoom level when a front facing module of the device isreceiving image data. In some implementations, a user may be able toassign different input types to control a common imaging operationdepending on which camera module is being utilized.

FIGS. 9A-9E depict an additional example of imaging operations performedin response to user input provided via an input surface of a device 920.FIG. 9A includes an electronic image capture device 920 including adisplay 921. The display 921 includes a preview image of a sceneincluding a first subject 983A and a second subject 983B in a scene. Thepreview image is based on image data received by a rear facing cameramodule of the device 920 (not shown in FIG. 9A) and can form part of apreview stream utilized by a user to frame and compose the scene beforecapturing one or more image frames (e.g., before capturing one or morevideo sequences and/or one or more still image frames).

Referring now to FIGS. 9A and 9B, a first hand 912 of a user isillustrated as supporting and positioning the electronic image capturedevice 920 and a second hand 916 of the user is used as an input elementto provide an input via an input surface of the display 921. In thisexample, a first digit of the second hand 916 (e.g., a forefinger) formsa first structure of the 918 of the user input element and a seconddigit (e.g., a thumb) forms a second structure 919 of the user inputelement.

Turning now to FIG. 9B, the example user input depicted in FIGS. 9A-9Ecan begin by positioning the first and second structures 918, 919 of theuser input element relative to the display 921. For example, as shown,the first and second structures 918, 919 can be positioned by the userto touch an input surface of the display 921 at selected locations. Ofcourse, in other examples, the first and second structures 918, 919 canbe positioned to hover relative to the display 921 (e.g., in deviceswith contactless or non-tactile gesture input capabilities).

Once the positioning of the first and second structures 918, 919relative to the display 921 is sensed by the device 920, a graphicalelement 991 can optionally be rendered on the display 921 to providefeedback to the user related to the positioning of the first and secondstructures. In some implementations, the graphical element 991 caninclude a first region 993 and a second region 995. In the illustratedexample, the first region 993 can include a bounding box formed suchthat opposite corners of the box lie below sensed positions of the firstand second structures 918, 919 of the user input element. Of course,other geometries can be implemented (e.g., other polygons or shapesincluding triangles, circles, squares, trapezoids, etc.). The firstregion 993 can include any suitable shape or geometry. For example, acircle, a square, a stylized icon, an asymmetrical shape with internaldetail, etc. Those having skill in the art will appreciate that thefirst and second regions 993, 995 can be selected to provide indicia toa user related to: 1) a sensed location of the first and secondstructures 918, 919 as used to control a first imaging operation and 2)a location for input related to a second imaging operation.

Turning now to FIGS. 9B and 9C, the example user input continues with acoordinated movement of the first and second structures 918, 919 of theuser input element relative to the display 921 and relative to oneanother. Specifically, the first structure 918 has translated along aninput surface of the display 921 between the position depicted in FIG.9B and the position depicted in FIG. 9C. Similarly, the second structure919 has translated along an input surface of the display 921 between theposition depicted in FIG. 9B and the position depicted in FIG. 9C.Additionally, the direction of movement of the first structure 918 isopposite the direction of movement of the second structure 919 in x-axiscoordinates and y-axis coordinates.

Those having skill in the art will appreciate that the movement of thefirst and second structures 918, 919 of the user input element observedby comparing FIGS. 9B and 9C depicts an example of an expansion of apinch gesture (e.g., an unpinch) applied via touch on the display 921.Turning now to FIG. 9C, it can be observed that the depicted movement orpinch gesture can be used to control a zoom level applied by the rearfacing camera module of the electronic image capture device 920. Forexample, the expansion of the distance between the first and secondstructures 918, 919 as represented by the first region 993 (e.g.,bounding box) results in an increased zoom level or zoom-in betweenFIGS. 9B and 9C.

Turning now to FIGS. 9C and 9D, the example user input continues withanother movement of the first and second structures 918, 919 of the userinput element relative to the display 921 and relative to one another.In this additional movement, the first structure 918 and secondstructure 919 have translated along the display back toward one another(e.g., in a direction toward the positions illustrated in FIG. 9B). As aresult, the pinch gesture or is used by the electronic image capturedevice 920 to decrease the applied zoom level between FIGS. 9C and 9D asobserved by comparing the sizes of the first and second subjects 983A,983B in these figures. Thus, it will be appreciated that an examplepinch and/or expansion of a pinch gesture or series of gestures can beused to control an imaging operation (e.g., to control a zoom leveladjustment operation).

Referring now to FIGS. 9B-9D, it can be observed that a location of thesecond region 995 of the graphical element 991 moves in response to achange in shape and/or position of the first region 993. Morespecifically, a position of the second region 995 relative to a cornerof the first region 993 remains constant even as the first regionchanges in shape and/or size as the first and second structures 918, 919move relative to the display 921. As a result, an x-y coordinatedistance and direction between the second structure 919 and the secondregion 995 is maintained as the locations of sensed input associatedwith the first and second structures 918, 919 move.

Those having skill in the art will appreciate that the electronic imagecapture device 920 can be configured such that the second region 995tracks a predetermined portion of the first region 993. For example, asshown, the second region 995 can be considered as tracking a location ofa lower, left corner of the first region 993. In other implementations,a portion of the first region 993 that is tracked by the second region995 can be selected by a user. For example, a user may select adifferent corner of the depicted first region 993 that the second region995 can track. Additionally, as mentioned above, those having skill inthe art will appreciate that the example of FIGS. 9A-9E can be practicedwithout the graphical element 991. For example, a user may provide theillustrated inputs, or equivalents thereof, without one or more of thefirst and second regions 993, 995 being rendered by the display 921. Insuch an example, the imaging operation discussed below with reference toFIG. 9E can be controlled by a selection of a display area that ispersistently positioned in terms of x-y coordinate distance anddirection relative to a sensed position of one or both of the first andsecond structures 918, 918.

Turning now to FIG. 9E, an advantage and improved user experienceprovided by the movement of the second region 995 based on the movementof the first and second structures 918, 919 of the user input element isshown. In this figure, the user has moved the second structure 919 toprovide a touch input at the second region 995. In some examples, theelectronic image capture device 920 can be configured to cause the rearfacing camera module to capture an image frame 950 in response to thetouch input at the second region 995. Of course, in other examples,additional or alternative imaging operations can be controlled inresponse to the user input via the second region 995 of the graphicalelement 991. For example, flash photography, AF, and/or AR operationscan be controlled. In any case, because the movement of the secondregion 995 between FIGS. 9B and 9D tracks the movement of touch input ofthe first and second structures 918, 919 represented by the first region993 (e.g., bounding box), a distance is maintained between the secondregion and a portion of the first region (e.g., the lower, left corner)throughout the user input operation. In this way, an amount ofcoordination and time required to transition between the first input tocontrol the zoom level (FIGS. 9B-9D) and a second input to control theimage capture (FIG. 9E) can be reduced as compared to the examplesdiscussed above with reference to FIGS. 1 and 2.

Still referring to FIG. 9E, in some embodiments a first imagingoperation (e.g., zoom level control) based on the locations of input ofthe first and second structures 918, 919 can be paused or concluded inresponse to an independent movement of one the first and secondstructures while the other structure maintains a touch input withoutmoving relative to the input surface of the display 921 (e.g., while theother structure remains stationary relative to the display). Forexample, as shown, the first structure 918 maintains a touch input onthe display 921 and does not move in position between FIGS. 9D and 9E.As a result, the zoom control operation depicted in FIGS. 9B-9E can bepaused to allow the user to select the second region 995 to initiate thesecond imaging operation (e.g., image frame capture). Stateddifferently, an independent movement of one of the structures can pausea relative movement of the second region 995 relative to the position ofthe moving structure so as to allow the user to select a still, unmovingregion. Those having skill in the art will appreciate that othertechniques can be utilized to signal a user's intent to transitionbetween imaging operations and that the user input depicted in FIGS.9B-9E can be achieved by maintaining touch input by both of the firstand second structures 918, 919 throughout the user input or can beachieved by providing intermittent or non-continuous touch input.

Turning now to FIGS. 10A-10C, imaging operations performed in responseto another example of a continuous user input are depicted. FIG. 10Aincludes an example electronic image capture device 1020 that issupported and positioned by a first hand 1012 of a user to frame ascene. Preview image frames depicting the scene are provided by adisplay 1021 which optionally outputs a graphical element 1091 includinga bounding box 1093 sized and shaped in response to sensed inputpositions of first and second structures 1018, 1019 (e.g., thumb andforefinger) of a second hand 1016 of the user.

Referring now to FIGS. 10A and 10B, the first and second structures1018, 1019 can be manipulated relative to one another and relative to aninput surface of the display 1021 so as to provide input relating to animaging operation. For example, as shown, a zoom level control operationis performed in response to an expanded pinch gesture performed betweenFIG. 10A and FIG. 10B. That is, a zoom level is increased by themovement of the first and second structures 1018, 1019 away from eachother and along the display 1021. As with other examples describedherein, those having skill in the art will appreciate that differentmulti-touch gestures can be implemented to control an imaging operation(e.g., to control a zoom level adjustment). In any case, the examplemovement of the first and second structures 1018, 1019 illustrated inFIGS. 10A and 10B can be considered a first type of user input receivedduring a first portion of a user input with an imaging operation beingcontrolled in response to the first type of user input.

FIG. 10C illustrates a release of the first and second structures 1018,1019 of the second hand 1016 from the display 1021. The release includesa separation 1061 between the first and second structures 1018, 1019 andthe input surface of the display 1021. In response to the release of thefirst and second structures 1018, 1019, a second imaging operationperformed by the electronic image capture device 1020 can be performed.For example, as illustrated, the release of the first and secondstructures 1018, 1019 can form a second type of user input that causesan image frame 1050 of the scene to be captured. In this way, it will beunderstood, similar to the examples described above with reference toFIGS. 5 and 6, that multiple structures from one or more input elementscan be used to provide a single, continuous user input to efficientlycontrol two or more imaging operations. For example, a first portion ofthe user input can include a first type of input (e.g., a draggingmovement of one or more structures along an input surface) to control afirst imaging operation and a second portion of the user input caninclude a separate type of input (e.g., a different type of movementalong the input surface and/or a release from the input surface) tocontrol a second imaging operation. Hence, a user experience whencontrolling different imaging operations in succession (or nearsuccession) can be improved by minimizing a time and/or coordinationrequired to transition between an input type to control a first imagingoperation and an input type to control a second imaging operation.

FIG. 11 is a flow chart illustrating an example operation 1100 forcontrolling a first imaging operation and a second imaging operation inresponse to a continuous user input. The example operation 1100 can beimplemented by the electronic image capture device 400 of FIG. 4.Further, those having skill in the art will appreciate that theoperation 1100 can be implemented in other example devices.

The operation 1100 begins at block 1101 with receiving, from a userinput surface, a continuous user input including a first portion and asecond portion. The user input can be received by a processor. Forexample, processor 406 of the example device 400 of FIG. 4. In someimplementations, the processor can be coupled to a camera module, theuser input surface, and a memory. Those having skill in the art willappreciate that the user input surface can be part of a touch-sensitivedisplay.

Turning now to block 1103, the example operation 1100 continues withcontrolling a first imaging operation based on a first input typeincluding movement of an input element relative to the user inputsurface during the first portion. In some implementations, the firstimaging operation includes a zoom level adjustment operation and thezoom level adjustment can be reflected in a preview stream that isdisplayed during the first portion. Further, in some implementations thefirst input type can include a twist of the input element relative tothe user input surface and/or a translation of the input elementrelative to the user input surface. In some implementations, the inputelement can include one or more fingers or a stylus.

Still referring to FIG. 11, the operation 1100 continues at block 1105with controlling a second imaging operation based on a second input typereceived during the second portion. The second imaging operation canoptionally be a different type of imaging operation than the firstimaging operation. For example, the second imaging operation can includean AF operation, a flash photography operation, an AE operation, animage capture operation, etc. In some implementations, the second inputtype can include a release of the input element from the user inputsurface and/or a translation of the input element relative to the userinput surface.

Still referring to FIG. 11, as discussed above, in some examples theoperation can include causing a touch-sensitive display including theuser input surface to display one or more graphical user interfaceelements. For example, a graphical user interface element can bedisplayed in a predetermined and persistent location or a location ofthe graphical user interface element can be based on a relative positionof the user interface element when the user input is initiated. In someembodiments, the graphical user interface element can include a firstregion and a second region. The first input type can include movement ofthe input element over at least a portion of the first region and thesecond input type can include movement along the user input surfacebetween the first region and the second region. Moreover, in someimplementations, movement of the input element during the first portioncan cause the second region to move relative to the first region duringthe first portion. For example, movement of the second region during thefirst portion can track a location of the input element relative to theuser input surface as the input element moves relative to the firstregion.

Those having skill in the art will appreciate that a device implementingthe example operation 1100 of FIG. 11 can include two or more cameramodules. In such examples, the first and second imaging operations canbe associated with a first camera module and other imaging operationsassociated with a second camera can be controlled in response to asecond user input. For example, the operation can optionally includereceiving a second continuous user input including a first portion and asecond portion, and controlling a first imaging operation associatedwith the second camera module based on a first input type receivedduring the first portion of the second continuous user input. The firstinput type received during the first portion of the second continuoususer input can be similar or different than the first input typereceived during the first portion of the first continuous user input.Additionally, the first imaging operation associated with the secondcamera module can be similar or different than the first imagingoperation performed in response to the first portion of the continuoususer input of block 1101. In this way, different camera modules (e.g.,front and rear facing camera modules on an example device) can becontrolled differently, or similarly, via separate continuous userinputs. For example, the first imaging operation associated with eachcamera module can relate to a zoom level adjustment. However, areceivable range of motion to control the first imaging operationassociated with the first camera module can be different than areceivable range of motion to control the first imaging operationassociated with the second camera module to account for differences ininput elements (e.g., a thumb vs. a forefinger) that may be expected foreach camera module.

FIG. 12 is a flow chart illustrating another example operation 1200 forcontrolling a first imaging operation and a second imaging operation.The operation 1200 begins at block 1201 with causing a display to outputa graphical user interface element including a first region. In someexamples, the graphical user interface element can be part of agraphical user interface that is output by a touch-sensitive display ofa device that also includes a memory, a processor, and a camera module.

Referring now to block 1203, the operation 1200 continues withreceiving, from a user input surface of the display, a first user inputtype including movement of an input element relative to the user inputsurface. In some examples, the input element can include a digit of ahand (e.g., a thumb and/or finger) or a stylus. Additionally, in someexamples, the movement of the input element relative to the user inputsurface can include a continuous tactile or touch input (e.g., a dragtouch gesture). In other examples, a contact between the input elementand the user input surface during the first user input type can beintermittent or the input element may provide a touchless gesture orinput. Skilled artisans will appreciate that the first input type caninclude different forms of movement of the input element relative to theuser input surface. For example, a twist and/or a translationalmovement.

Block 1205 of operation 1200 includes controlling a first imagingoperation based on the first input type. In some examples, the firstimaging operation can include an AF operation, an AE operation, a flashphotography operation, a region of interest tracking operation, a cameramode selection operation, and/or a zoom level adjustment operation.Further, in some embodiments, the processor can optionally be configuredto cause the display to output a preview stream received from the cameramodule while the first input type is received to provide feedback to auser related to the first imaging operation.

Turning now to block 1207, the first region is caused to move relativeto the user input surface while the first input type is received. Insome examples, the movement of the first region can be based on a motionof the input element relative to user input surface. For examples, thefirst region can move to track a position of the input element relativeto the user input surface. In this way, a distance and/or a directionbetween the input element and the first region can be maintained whilethe first input type is received. In some implementations, at least oneof the distance and/or direction between the input element and the firstregion can be user adjustable and/or selectable. Those having skill inthe art will appreciate that the movement of the first region canfacilitate a transition between the first input type and a second inputtype.

Still referring to FIG. 12, in some implementations the graphical userinterface element can include a second region. For example, a secondregion of the graphical user interface element can be maintained in astationary location relative to the user input surface while the firstinput type is received. The first input type can include a movement ofthe input element over at least a portion of the second region. Asdiscussed above, in some examples, the graphical user interface elementcan include a third region that moves relative to the second region andthat tracks a movement of the first region. For example, a user mayprovide input via the third region and the third region can move alongwith the location of user input.

Turning now to block 1209, the operation includes controlling a secondimaging operation based on a second input type that is received afterthe first input type. The second input type includes a selection of thefirst region by the input element. In some examples, the second imagingoperation can include an image frame capture operation. Or course, thefirst input type can optionally be received during a first portion of acontinuous user input with the second input type received during asecond portion of the continuous user input. In this optionalembodiment, the second input type can include a translation of the inputstructure relative to the input surface. For example, the input elementcan include a first structure (e.g., a finger) and a second structure(e.g., a thumb and/or finger). In this example, the first and secondstructures can move relative to one another and relative to the userinput surface while the first input type is received. Further, one ofthe first and second structures can remain stationary while the secondinput type is received while the other moves relative to the user inputsurface to select the first region of the graphical user interfaceelement.

Finally, it should be noted that the example operation 1200 of FIG. 12can be implemented in an electronic image capture device (e.g., any ofthe devices described herein) including, or having access to, a cameramodule. In devices having two or more camera modules, the devices may beconfigured to output a first graphical user interface element to controlimaging operations associated with a first camera module, and to outputa second graphical user interface element to control imaging operationsassociated with the second camera module. In this way, the similarimaging operations related to the first and second camera modules can becontrolled based on inputs received from differently configuredgraphical user interface elements. Alternatively, different imagingoperations associated with each camera module can be controlled based oninputs received from similarly configured graphical user interfaceelements.

Certain aspects and embodiments of this disclosure have been providedabove. Some of these aspects and embodiments may be appliedindependently and some of them may be applied in combination as would beapparent to those of skill in the art. In the foregoing description, forthe purposes of explanation, specific details are set forth in order toprovide a thorough understanding of embodiments of the invention.However, it will be apparent that various embodiments may be practicedwithout these specific details. The figures and description are notintended to be restrictive. Rather, the ensuing description of theexemplary embodiments will provide those skilled in the art with anenabling description for implementing an exemplary embodiment. It shouldbe understood that various changes may be made in the function andarrangement of elements without departing from the spirit and scope ofthe invention as set forth in the appended claims.

Specific details are given in the following description to provide athorough understanding of the embodiments. However, it will beunderstood by one of ordinary skill in the art that the embodiments maybe practiced without these specific details. For example, circuits,systems, networks, processes, and other components may be shown ascomponents in block diagram form in order not to obscure the embodimentsin unnecessary detail. In other instances, well-known circuits,processes, algorithms, structures, and techniques may be shown withoutunnecessary detail in order to avoid obscuring the embodiments.

Also, it is noted that individual embodiments may be described as aprocess which is depicted as a flowchart, a flow diagram, a data flowdiagram, a structure diagram, or a block diagram. Although a flowchartmay describe the operations as a sequential process, many of theoperations can be performed in parallel or concurrently. In addition,the order of the operations may be re-arranged. A process is terminatedwhen its operations are completed, but could have additional steps notincluded in a figure. A process may correspond to a method, a function,a procedure, a subroutine, a subprogram, etc. When a process correspondsto a function, its termination can correspond to a return of thefunction to the calling function or the main function.

Moreover, the various illustrative logical blocks, modules, circuits,and algorithm steps described in connection with the embodimentsdisclosed herein may be implemented as electronic hardware, computersoftware, or combinations of both. To clearly illustrate thisinterchangeability of hardware and software, various illustrativecomponents, blocks, modules, circuits, and steps have been describedabove generally in terms of their functionality. Whether suchfunctionality is implemented as hardware or software depends upon theparticular application and design constraints imposed on the overallsystem. Skilled artisans may implement the described functionality invarying ways for each particular application, but such implementationdecisions should not be interpreted as causing a departure from thescope of the present invention.

Further, the various illustrative logical blocks, modules, circuits, andalgorithm steps described in connection with the embodiments disclosedherein may be implemented in any of a variety of devices such as generalpurposes computers, wireless communication device handsets, orintegrated circuit devices having multiple uses including application inwireless communication device handsets and other devices. Any featuresdescribed as modules or components may be implemented together in anintegrated logic device or separately as discrete but interoperablelogic devices. If implemented in software, the techniques may berealized at least in part by a computer-readable data storage mediumcomprising program code including instructions that, when executed,performs one or more of the methods described above. Thecomputer-readable data storage medium may form part of a computerprogram product, which may include packaging materials. Thecomputer-readable medium may comprise memory or data storage media, suchas random access memory (RAM) such as synchronous dynamic random accessmemory (SDRAM), read-only memory (ROM), non-volatile random accessmemory (NVRAM), electrically erasable programmable read-only memory(EEPROM), FLASH memory, magnetic or optical data storage media, and thelike. The techniques additionally, or alternatively, may be realized atleast in part by a computer-readable communication medium that carriesor communicates program code in the form of instructions or datastructures and that can be accessed, read, and/or executed by acomputer, such as propagated signals or waves.

The program code may be executed by a processor, which may include oneor more processors, such as one or more digital signal processors(DSPs), general purpose microprocessors, an application specificintegrated circuits (ASIC s), field programmable logic arrays (FPGAs),or other equivalent integrated or discrete logic circuitry. Such aprocessor may be configured to perform any of the techniques describedin this disclosure. A general purpose processor may be a microprocessor;but in the alternative, the processor may be any conventional processor,controller, microcontroller, or state machine. A processor may also beimplemented as a combination of computing devices, e.g., a combinationof a DSP and a microprocessor, a plurality of microprocessors, one ormore microprocessors in conjunction with a DSP core, or any other suchconfiguration. Accordingly, the term “processor,” as used herein mayrefer to any of the foregoing structure, any combination of theforegoing structure, or any other structure or apparatus suitable forimplementation of the techniques described herein. In addition, in someaspects, the functionality described herein may be provided withindedicated software modules or hardware modules configured for encodingand decoding, or incorporated in a combined video encoder-decoder(CODEC).

As noted the computer-readable medium may include transient media, suchas a wireless broadcast or wired network transmission, or storage media(that is, non-transitory storage media), such as a hard disk, flashdrive, compact disc, digital video disc, Blu-ray disc, or othercomputer-readable media. In some examples, a network server (not shown)may receive encoded video data from the source device and provide theencoded video data to the destination device, e.g., via networktransmission. Similarly, a computing device of a medium productionfacility, such as a disc stamping facility, may receive encoded videodata from the source device and produce a disc containing the encodedvideo data. Therefore, the computer-readable medium may be understood toinclude one or more computer-readable media of various forms, in variousexamples.

While the present disclosure shows illustrative aspects, it should benoted that various changes and modifications could be made hereinwithout departing from the scope of the appended claims. Additionally,the functions, steps or actions of the method claims in accordance withaspects described herein need not be performed in any particular orderunless expressly stated otherwise. Furthermore, although elements may bedescribed or claimed in the singular, the plural is contemplated unlesslimitation to the singular is explicitly stated. Accordingly, thedisclosure is not limited to the illustrated examples, and any means forperforming the functionality described herein are included in aspects ofthe disclosure.

What is claimed is:
 1. A device comprising: a memory; and a processorcoupled to a camera module, a touch-sensitive display, and the memory,the processor configured to: receive, from the touch-sensitive display,a user input including a first portion and a second portion; control azoom level adjustment operation based on a first input type receivedduring the first portion, the first input type including movement of aninput element relative to the touch-sensitive display, wherein movementof the input element during the first portion along the touch-sensitivedisplay causes a second region of a graphical user interface element tomove relative to a first region of the graphical user interface elementduring the first portion of the user input; and control an image framecapture operation based on a second input type received during thesecond portion, wherein the second input type includes an interactionwith the second region of the graphical user interface.
 2. The device ofclaim 1, further comprising: the camera module.
 3. The device of claim2, wherein the processor is configured to cause the touch-sensitivedisplay to display a preview stream received from the camera moduleduring the first portion of the user input, wherein the preview streamrepresents, at least partially, the zoom level adjustment operationduring the first portion of the user input.
 4. The device of claim 1,wherein the first input type includes movement of the input elementalong the touch-sensitive display over at least a portion of the firstregion.
 5. The device of claim 4, wherein the second input type includesa movement of the input element along the touch-sensitive displaybetween the first region and the second region.
 6. The device of claim1, wherein the movement of the second region during the first portiontracks a location of the input element relative to the touch-sensitivedisplay as the input element moves relative to the first region.
 7. Thedevice of claim 6, wherein a distance between the input element and thesecond region is persistent during the first portion.
 8. The device ofclaim 1, wherein the first input type includes a twist of the inputelement relative to the touch-sensitive display.
 9. The device of claim8, wherein the second input type includes a translation of the inputelement relative to the touch-sensitive display.
 10. The device of claim1, wherein the first input type includes a translation of the inputelement relative to the touch-sensitive display.
 11. The device of claim10, wherein the second input type includes a translation of the inputelement relative to the touch-sensitive display.
 12. The device of claim10, wherein the input element includes a first structure that translatesrelative to the touch-sensitive display and a second structure thattranslates relative to the touch-sensitive display during the firstportion, wherein the first structure and the second structure are spacedapart from each other on a plane that is parallel to the touch-sensitivedisplay.
 13. The device of claim 12, wherein the second input typeincludes a translation of the first structure relative to thetouch-sensitive display and wherein the second structure is stationaryrelative to the touch-sensitive display during the second portion. 14.The device of claim 1, wherein the processor is coupled to a secondcamera module, the second camera module facing a different directionthan the camera module, the processor configured to: receive, from thetouch-sensitive display, a second user input including a first portionand a second portion; control a zoom level adjustment operationassociated with the second camera module based on a first input typereceived during the first portion of the second user input, the firstinput type received during the first portion of the second user input,the first input type including movement of the input element relative tothe touch-sensitive display; and control an image frame captureassociated with the second camera module based on a second input typereceived during the second portion of the second user input.
 15. Thedevice of claim 14, wherein a receivable range of motion to control thefirst imaging operation based on the first input type of the user inputoperation is different than a receivable range of motion to control thefirst imaging operation of the second camera module based on the firstinput type of the second user input operation.
 16. The device of claim1, wherein the image frame capture operation includes a video captureoperation.
 17. A method comprising: receiving, from a touch-sensitivedisplay, a user input including a first portion and a second portion;controlling a zoom level adjustment operation based on a first inputtype received during the first portion, the first input type includingmovement of an input element relative to the touch-sensitive display,wherein movement of the input element during the first portion along thetouch-sensitive display causes a second region of the graphical userinterface element to move relative to the first region of the graphicaluser interface element during the first portion of the user input; andcontrolling an image frame capture operation based on a second inputtype received during the second portion, wherein the second input typeincludes an interaction with the second region of the graphical userinterface.
 18. The method of claim 17, further comprising causing thetouch-sensitive display to display a preview stream received from acamera module during the first portion of the user input, wherein thepreview stream represents, at least partially, the zoom level adjustmentoperation during the first portion of the user input.
 19. The method ofclaim 17, wherein the first input type includes movement of the inputelement along the touch-sensitive display over at least a portion of thefirst region.
 20. The method of claim 19, wherein the second input typeincludes a movement of the input element along the touch-sensitivedisplay between the first region and the second region.
 21. The methodof claim 17, wherein the movement of the second region during the firstportion tracks a location of the input element relative to thetouch-sensitive display as the input element moves relative to the firstregion.
 22. The method of claim 21, wherein a distance between the inputelement and the second region is persistent during the first portion.23. A non-transitory computer-readable storage medium storinginstructions thereon that when executed cause one or more processors to:receive, from the touch-sensitive display, a user input including afirst portion and a second portion; control a zoom level adjustmentoperation based on a first input type received during the first portion,the first input type including movement of an input element relative tothe touch-sensitive display, wherein movement of the input elementduring the first portion along the touch-sensitive display causes asecond region of a graphical user interface element to move relative toa first region of the graphical user interface element during the firstportion of the user input; and control an image frame capture operationbased on a second input type received during the second portion, whereinthe second input type includes an interaction with the second region ofthe graphical user interface.